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ABSTBACT 

J)iscussing Controversial Issues (DCI) is a skill 
training prograa designed for high school studen*^ and teachers vith 
an overall objective pf develbping student and teacher skill in 
diiscussing controversial issues effectively. The course naterials 
identify 13 aodera tor techniques vhich.^beachers practice, i&hd 13 
participant techniques vhich students practice* Behavipral data ftere 
cfollected by audiotape recordinq^ a 25*Minate classroom discussion on 
on a controversial issue both belf ore and after the cotirae. 
Questionnaires^ vocabulary tests,' veekly logs of issues, and 
classrooB observation vere utilized and inter-rater reliability ,vas 
conputed. Behavioral, results for students and teachers are presented. 
Critiquers, students, and teachers ^^aaich used t>ie saee scale to rate 
the discussion. Postcourse Teacher Questionnaires vere filled out by 
the teachers and in qeneral, stronq support vas given to the 
usefulness of the course. Overall, DCI produced an ipprove^ent' in the 
use of discussion techniques. Be^jofause of feedback frov student's and 
teachers, several xe visions vill be nade in the course naterials and 
techniques. (BC) \. , 
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INTRODUCTION 

•>...'. 

Discussing Controversial Issues (DCI)* is a ski 11 -training program 
designed for high school teachers and students. The overall course 
objective is to develop teachers' and students' skills in discussing con- 
troversial issues effectively, . > 

The main rationale for developing such a course is the fact that in 
order to become effective citizens, students must be able to cope rationally 
with the value dilemmas and conflicts that the diversity of our society 
creates. Schools should also help students discriminate critically among 
alternative courses of action. 

One my to help students deal with controversy is to have xiiscussibns 
that involve an open exchange of views in a rational climate of shared 
responsibility. Curricula involving discussion exist, but there are few 
programs to train teachers or ^tudents in discussion techniques. Both 
teachers and students will have more effective discussions of controversial 
issues if they learn specific discussion techniques. 

Discussing Controversial Issues presents the viewpoint that the pur- 
pose of a controversial issues discussion should be to develop students' 
insights into their own and other people's opinions. Teachers should not 
use discussions to indoctrinate students or to impose their value judgments 
on students. Instead, this goal should b^ to expose students to all points 
of view and to help them develop criteria for making their own judgments. 
To do this, teachers need tO' assume the nonjudgmental role of a facilitator 
or moderator, and students need to assume the role of active participants. 

* The main field test version, reported on h^e, was titled Mini course 14; 
A Discussion Approach to Controversial Issues .- 



The course materials identify thirteen moderator techniques, which 
teachers practice, and thirteen participant techniques, which students 
practice. These techniques along with the course objectives are listed on 
the next two pages. Many of the techniques are based on the work of Oliver 
and Shaver (1966) done at Harvard University and Massialas (1966) at the 
University of Michigan. 

For students the course was a unit of study in one of their regular 
classes. Several teachers incorporated the discussion into the ongoing 
curriculum; others treated PCI as a separate unit. 

The purpose of the main field test was to obtain data on.behavioral 
changes associated with PCI . Course techniques were analyzed individually 
in order to assist iu the subsequent revision. 

, Course objectives and discussion techniques are presented separately 
for the moderator and the participants. Tables 18, 19, 20, and 21, listing 
all 'the behavioral results, are presented in the Appendix. 
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Table la 

COURSE OBJECTIVES AND TECHNIQUES 



COURSE OBJECTIVE: 



To develop teacher and student skills needed for effec- 
tive discussion of controversial issues, and to develop 
student insight into their positions on issues. 



INTRODUCTION 



[LESSON ONE 



ILESSON TWO' 



[LESSON THREEI 



LESSON FOUR 



TECHNIQUES FOR THE MODERATOR 

Objective: To develop your skill in init^J^ng a dis- 
cussion of controversial Issues. 

1. Involve stud(&nt%in deciding what issue to discuss. 

Objective : To develop your skill in maintaining a dis- 
cussion of controversial issues in which different 
points iQ(f view are openly expressed. 

% ' ■ " 

1. Use supportive silence. 

2. Ask students who haven't spoken what they think. 

3. Suppoft the right to speak of a student who 
expresses an unpopular point of view. 

Objective : Tcr develop your skill in listening and 
keeping the disclission focused on the controversial 
issue- 

1. State the issue at the beginning of the di'^cusslon. 

2. Question the relevancy of remarks. ^ 

3. Summarize discussion trends. 

Objective : To develop your ski 11 in probing and under- 
standing different positions on an issue. 

1. Ask for a temporary agreement to allow the discus- 
sion to be resumed after a deadlock. 

2. Point out places where students should use partici- 
pant techniques. 

Objective : To develop your skill in ending a discussion, 
by evaluating its effectiveness. 

1. Ask for a brief revtew of the discussion. ^ 

2. Ask students to state positions different from their own. 

3. Ask if anyone has modified his poj^ition. 

4. Discuss with students whether and how they want to 
continue to deal with the issue. 



Table lb 
TECHNIQUES FOR PARTICIPANTS 



Objective : To develop your skill in initiating a 
discussion of controversial issues. 

1. Decide which controversial issue to discuss. 

Objective : to develop your skTll in maintaining 
a discussion of controversial issues in which 
different points of view are openly expressed. 

1. Talk to each other rather. than to the moderator. 

2. Avoid monopolizing; give several others a chance 
to speak after you've spoken. 

3. Avoid speaking in a hostile tone of voice or . 
engaging in personal attack. 

Objective : To develop your skill in listening and 
keeping the discussion focused on the controversial 
issue. ' 

1. Acknowledge a previous speaker. / 

2. Question the relevancy of speakeirs' remarks to 
the issue being discussed. 

Objective : , To develop your skill in probing and 
understanding different positions on an issue. 

1. Ask for clarification. 

2. Ask for evidence. 

3. Ask about values. . 

Objective : To develop your skill in ending a 
discussion by evaluating its effectiveness, 

1. Review the main points of discussion. 

2. State positions different from yours. 

3. State any modifications you've made in your 
own position. ' 

4. Decide whether and how you want to continue 
to deal with the issue. 



s 



Sample 

I, ■ • . _ . . . . 

After seeing an overview of D1 scus si ng . Controvers 1 a1 I ssue s > teachers . 
were invited to volunteer to participate in the main field test held during 
Spring 1971. In addition to the use of the course the Far West Laboratory 
offered to supply coordination and the necessary equipment. 

Two semester units from the College of Notre Dame in Belmont, California, 
were availaFle to those who completed the entire coiirse. Of the 46 teachers 
who volunteered to participate in the training, 30 chose to receive college 
credit. Grades 8 through 12 including several ability levels were repre- 
sented. Other sample characteristics aire presented in Tables 2 and 3. 



Control Group 

An attempt was made to/recruit a control group by offering a $15.00 
hondrarium tb other teachers in the same schools for the dompletion Of two 
25-minute audiotapes of a classroom discussion of a controversial issue^ 
As Tables 3 and 4 show, the experimental and control groups were nonequiva- 
lent; furthermore, we were unable to control for pre-post practice effects. 
The subsequent analysis verified that indeed we had been unsuccessful in 
our attempt to get a true control group. Because of this difficulty, the 
results for the "control" group ar^- presented separately In the Appendix 
instead of in the'main body of this report. The "control" group had sub^ 
stantially higher entry levels on the key istudent variables of acknowledg- 
♦ nient and Interaction. In addition the "control" moderators indicated more 
confidence (before the course) in thetr skill as flwderators and their ability 
to teach a course on dii^cussing issues. \ 



Dichotomizing the Study. 

, . ■ ' • • . ■ ■ ■ 

As a result of field observations and the subsequent data analysis^ it 
became appaj^etft that most of the 17 classes in two of the urban schools 
reacted to DCI_ in a markedly different way fr'om the rest of the sample. 
These two inner city school s> which included compensatory and opportunity 
classes^ exhibited considerably lower entry levels and less improvement on ^ 
several variables than did the other experimental classes. Interviews with 
the teachers in these schools revealed that for many of the students DCI was 
an intrusion into their previous arrangements regarding their curricula. 
Having been given the option of attendance for prior curricula, they now 
resented having to take\ part in the course every day for over four weeks. 

Because of these ci\rcumstances> it was decided to the two 

deviant schools se^^arately from the rest of the sampje. , For ease in reference, 
the ana lysis of the main sample i§. referred to as Study 1 (E| = experimental , 

= control) with the remaining two schools described under Study 2. The 
'relative lack of success\ iri the Study 2 schools ijimits the scope of general- 
izability regarding the course's effectiveness, i 



Data Collection 

\- • 



recording a.25-minute 



Behavioral data were collected by audiotape 
classroom discussion on a controversial issue both l>ef ore and after the 
course. A Laboratory field worker signaled the teacher when 5 minutes 
remained in each discussion. 

Questionnaires, vocabulary tests, weekly logs of issues, and class- 
room observation were also utilized. \ In addition, teachers, students, and 

Laboratory critiquers used the same sif ale to rate independently the 

1. " ■ 
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TaisTe 2 
Sample Elrea1<clown 



Number of Classrooms 



Experimental 


Control 


18 / 


8 -r 


17 


7 


8 


4 


43 




1100 


500 



San Francisco Bay Area (urban)i 
San Francisco Bay Area (suburban) 
Fresno, California (private, Catholic) 



ftpprdximate number of students 



\ 

' \ ■ 


\ ■■ 


Table 3 
3e)( of TeacJier 




- -- 1 
■ \ ■ 


/ Experimental ' 


Control 


Study 1 


Male 
Female 




18 
14 




5 
8 


Study 2 


Male 
Female 




' \: 1 

4 

- ?3 




■2 
4 






- - . ^ ■ 'A •■ 
Table 4\ ^ 




■ o 

* 




Grade Level and Vocabulary Score 

■ ■ . . / 








-Grade Level ^' 


"VocaKularv Score 


(Maximum =20) 




X 


S.D. , 


X 


S.D. 




10.2 
9.9 


1.2 . 
1.3 


14.0 
13.6 




1.9 
1.3 


% 


11.6 
11.0 


.5 
.9 


13.5. 
12.8 




2.5 
1.3 
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discussions on the following six aspects: (1) whether the discussion moved 
along smoothly, (2) whether students were talking to each other and not 
just the moderator, (3) whether students were really listening, (4) whether 
the discussion remained? focused on the 4ssue, (5) whether students learned 
from the disciTssion, and (6) the effect of the discussion in terms of posi- 



tive acti9 



Inter-rater Reliability 

• , ;/: . \ . ■ 

C "' . ' ■ ■ ■ ' j 

Each audiotape was independently scoried by two of four critiquers, 
none of whom was on the development team. Pearson product-moment correla- 
tion coefficients were computed for the variables with an underlying con- 
tinuous distribution. For dichotomous variables, percent of agreement is 
reported. The r's reported in Table u represent weighted averages of the 
r's computed separately for each combination of two raters. Since average 
scores were used in the analysis, the r's were adjusted using the Spearman- 
Brown prophecy formula (Hoi^st, 1966). 

In general the reliabilities appear to be lower than those obtained 
in previous evaluations of courses developed by the Far West Laboratory. 
The variables in this study, however, are somewhat unique and the discus- 
sions include a large amount of rapid student, interaction. For variables 
with low occurrence, the product -movement correlation is not necessarily 
a good measure of accuracy of agreement; for example, ^although the tally 

differences between raters fbr. the variable "asked about values" were 

^ ' ! ■ ^ • " - • 

rarely greater than on^i, the reliability is very low (.43). Other than for 

* ■ ^ • , • • \ 
this variable, the lowest reliability cocfflcients^ccurred for the scaled 



subjective ratings which were done after 



the other behavlbrs^-were scored. 
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Table 5 
/ Inter-rater Reliability 



Moderator Techniques 



Calls on non-talker .74 

Summarizes discussion trends ^ .79 

Asks students to use techniques .68 

'Questions relevancy .78 

.Asks for temporary agreement .73 

Miscellaneous moderator talk .96 

Non-moderator talk ' .89 

' Participant Techniques 

'/■...' . - ■ > ' • • • 

Asks for^ /Evidence .87 

Asks about values .43 

Asks f6r clarification / .80 

Questions relevancy .80 

Personal attack ^ .81 

Stuclent-teacher interaction ' .97 

vj\cknpwledges a previous speaker ,96 
Does not acknowledge a previous speaker . .68 

Rat ing ' Scales * * . 

- — — ■ * ■ . <j 

'•Smoot+irtess of disciission ^ .65 

.Students talking to each other .81 

Students listening to each other .47 

Discussion remained focused on the issue!' .66 

Students learned ^ ' ' -52 

Discussion of positive effect \' .46 

.. ' , i . • : • \ • ' ^ -.■ 

Djchotomous' Variables' Percent of Agreement 

Issue, stated explicitly. . ' 81% 

Unpopular position taken by student - 90% 

Discussijon bogged down " . ^ 90% 

Moderator asks for review . 78% ^ 

Students gfve adequate review 87% 

Moderator asks for opposi no/ position • 98% 

Students state opposiirjg position accurately " 96% 
Moderator as ks for modi f i cati on ^ 93% 

Studeats give modi ficatiori " 95% 

Moderator asks about the next step . ' 95% 

Students discuss the next step 9355 




BEHAVIORAL RESULTS 



Introduction 

The moderator results are presented in the order in which each 
technique appears in the Teacher Handbook (see Table 1a) » followed by 
the results of the student participants. Although the rating scales 
were based on the same raw behavioral data (i.ea> the audiotaped dis- 
cussions) , they are presented in a separate section in order to faa il^ ^^ ^v 
itate presentation of the data. The final summary will incorporate a|^l 
resurK together. 

In reading the tables» one must be cautious in comparing Study 1 
with Study 2. The size of the p's cannot be used to assess relative^ 
difference in shifts, since the degrees of freedom based on sample size 
are quite different. 

The tests of significance (i.e., the one-tailed t-tes,ts for correlated 

i^T'' ' 

scores) are presented mainly for those readers who are used to such re- V 
porting. Difficulties associated with this method of analysis are 
described in several sources (e.g», Morrison and Henkel, 1970). 

Finally, the percentage of teachers or classes of students who ^ 
improved is presented for each of the techniques. This statistic gives 
a measure of how Widespread the behavioral, changes are. 



- Lessons 1 and 2 



N^=32 N2=n 









Pre 






Post 






% Im- 


Variable 


Groijip 


X 




S.D. 


X 




S.D. 


t 


proving 


Lesson 1 






- 














Percentage of K 
teacher talk 
(T/T+S) 


El 


33.9% 
36.3% 




12. 3I 
8.7l 


22.6% 
33.6% 




11. ll 
12.61 


-4.0** 
.5 


75% 
45% 


Non-moderator 
talk 


c 


5.9 
2.6 




5.0 
1.9 


4.2 
5.1 




2.7 

■ 5.2 


-1:9 
1.5 


59% 

'55% 


Modei^ator calls 
on non-talker 


\ 


2.1 
1.3 




2.1 
1.2 


1.1 
1.4 




1.2 
•2.0 

■ 


-2.7** 
.1 


22% 
45% 


Lesson 2 




















Moderator states 
issues at beginninc 
(percentage using 
techniques) 






75% 
45% 






84% 
73% 






9% 
28% 

• 


Moderator ques- 
tions relevancy 




.1 
0 




.3 

0 


.4 
.1 




■7 
.3 


2.0* 
1.0 


31% 
9% 


Moderator 
sufnmarizes discus- 
sion trends 


El 

h 


.9 
.4 




.9 
.5 


1.4 
.7 




".8 


2.2* 
1.2 


63% 
27% 



Standard deviations are expressed in percent units. 

* p<.d5 N. 

** p<.01 (decreases) - / 
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Evaluation of Teachers' Use of Moderator Techniques 

Lesson 1 

Technique : Use supportive silence. 

Measure a : Percent of teacher talk in a five-minute portion taken from the 
middle of the tape. 

The data represent the proportion of the number of times the teacher 
spoke in^ relation to the total number of utterances by both students and 
the teacher. 

Ey (the main experimental group) made a substantial change, while E^ 
showed some improvenent. The entry levels for this variable are quite a bit 
lower than those found in previous Far West Laboratory studies, which sampled 
from classroom interaction not necessarily of the discussion type. 

Measure b : Number of instances of non-moderator talk in a ISrminute 

■^^^ ~^ ' ^ ■■ 

portion. 

Teacher talk which did not qualify iais one of the moderator techniques 
or as miscellafieous moderator talk was classified as non-moderator talk. 
Miscellaneous moderator talk includes things like the teacher calling on 
students who request to speak or dnswering'ia question from a student. 

This measure was an attempt to improve upon previous teacher talk 
measures which did not attempt to differentiate between desirable and un- 
desirable talk on the part of teachers. 

Only the nain experimental group imptwed in decreasing their use of 
non-moderator behavior. The Increase shown by Eg is difficult to explain. 
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Technique:/ Ask students who haven't s^^poken what they think. 

Measure : Number of times in 15 minutes that the moderator calls on 

i ■ ■ 
a non-talker. 

When this variable was first defined, the authors had planned to use 
videotapes to record the discussions. The subsequent move to audiotape 
made this a difficult variable to measure. Raters had to (1) hear specific 
comments by the moderatpr (e.g., "You haven't said anything, Pat. What do 
^ou think about .this?") or (2) if the moderator simply s^id something like 
"What do you think, Todd?" and Todd's voice appeared to be one that the rater 
^t^ad not heard previously. 
\ The results here are inconclusive. As with several other techniques, 
it is difficult to assess appropriateness; for example, if all students 
participate actively, then the technique of calling on non-talkers is not 
needed. 

For the students' perception of how much they each participated in the 
discussion, see the section on the student questionnaire (pages 43 and 44 )j. 

Technique : Support the right to speak of a student who expresses an un- 
popular point of view. ■ ' - 

Measure : Of the number of times which a student expresses an unpopular 
viewpoint (as evidenced by general disagreement from the rest 
of the group), the proportion of the time that the moderator 
expressed support for the particular student. 

So infrequent was the occurrence of a student expressing an unpopular 
point of view (9 times in a total of 124 tapes) that the measurement of this 
technique was not carried further. 
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Lesson 2 

Technique : State the issue at/ the beginning of the discussion. 

Measure : Percent of teachers who state the issue in specific terms at 

/ £he beginning of the discussion. 

Mere statements of the general topic were not counted (e.g;, "The 

\ ' ' ■ • ' • ■ 

I • • • . . . • 

discussion foi* today is on marijuana."). The issue had to be stated in a 
form such as 'Ishould marijuana be legalized?" ^\ 

Technique : Question the relevancy of remarks, \ 
Measure : Number of times moderator questions relevancy in a l^minute 
portion, 

, ■ ■-■./■■ ■ • 

Raters tallied whenever the moderator asked students about the,rela<- 
tionship of their remarks to the issue at hand> e.g.* "How does your 
example relate to the legalizing ^of marijuan-S?" 

The low frequencies here make the data analyses somewhat academic. 
As mentioned earlier* it is difficult to assess whether the behavior was or 
was not appropriate. If* on the posttest* students make fewer irreleviant 
remarks* then naturally these "desirable" moderator techniques should 

■ " •X-' ' • . 

decrease. Atrelated measure is the rati ng^f^ whether the discussion 
focused on the issue (see Tabl€ 11 orr page 30) . - v - - 

Technique : Suninarize discussion trends. ^ 

Measure : Number of times during 15 minutes of discussion that the 

'•>•■♦•■ • • 

moderator asks for a summary. \ 
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This technique was tallied whenever the moderator gave a sufiiiiary or 
incor^ptjrated^i:wo jor more students' positions or discussed in what direc- 
tion the discussion was heading. 

For this variable, a ceiling effect is operating in that it is 
probably undesirable to summarize discussion trends more than one or two 
, times. It would appear that E, 's posttest use of this skill is satisfactory. 
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Table 7 

Teacher Use of Moderator Techniques 

Ni=32 N2=ll 



- Lessons 3 anjl 4 




lesson 3 
Moderator 

temporary agreement 

(Moderator asks ' 
students to use , 
techniques i 



.9 

*3 



1.1 
.4 



1.4 
1.4 



1.5 
1.4 



2.1* 
1.1 



2.7* 
2.7* 



% Im- 
proving 



31% 
18% 



59% 
73% 



Lesson 4 (Percentage Using Techniques) 



Moderator ^sks 
for review 

Moderator asks 

for positions 

di f f erent than own 

Moderator asks 
for modifications 

Moderator dis- 
cusses, the next" 
step 



:1 



-I 

h 



53% 
45% 



6% 
0 

0 

18% 



3% 
9% 



81% 
55% 



28% 
0 

16% 
0 



28% 
45% 



.02 
;34 



.01 



.03 
.25 



.00 

.Oi5 



* p<.C5 

^ Probability levels derived from the Binomial Test (Siegel, pp. 36-42). 



Lesson 3 

Technique : Ask for a temporary agreement to allow the discussion to be 

. T resumed after a deadlock. 
Measure : Of th,e deadlocks that occurred, the proportion in which the 
moderator asked for a temporary agreement. 

Deadlocks, as defined by raters' deciding whether the discussion 
bogged down due to disagreements, occurred in only 10 of 124 discussions. 
Therefore, the average number of instances of temporary agreement is listed 
for each group without the finer analysis. Although showed a statis- 
tically significant improvement, the posttest was still rather low with 
fewer than a fourth of the classes using the techniques. The low occurrence 
of deadlocks suggests that the technique of temporary agreement was not 
needed. 

Technique; Point out places where students shouldaise4Mirtici pants' 
techniques. / 

Measure : Number of times moderator a^ks students to use the participant 
technique of (1) asking for clarification, (2) asking for 

evidence, or (3) asking about values in a 15-mlnute portion. 

■ . ■ f • ' / ' 

Bath groups showed improvement in the use of this moderator 

■ ' ■ ■ ' ■ ■ ■ .'" -"/ 

technique. / 
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Lesson 4 

Technique : Ask for a brief review of the discussion. 
Measure : Percent of teachers who ask for a review at least once during 
the last eight minutes of the discussion. 

The main experimental group made a significant gain and had a 
substantially higher percentage of teachers using this skill. 

Technique : Ask students to state positions different from their own. 
Measure : ^Percent of teachers who, during the last eight minutes of the 
discussion, ask students to state other students* positions. 

* . . ■ ■>*.." 

Again only the main experimental group shows a substantial improve- 
ment. Even here, however, the postcourse percentage is still rather low 
(28%). . 

A possible explanation is the fact that many classes were unable to 
corpplete a discussion- in the 25-minute taping period. Although a Labora- 
tory field worker signaled when there were five minutes remaining, many 
classes never got around to formally concluding their discussions. 

Other classes may not have had time to use all four techniques in 
the brief ending time period.. 

Technique : Ask If anyone ha s modi fled hi s posi ti on^ _ 

Measure: Percent of teachers who, during the last eight minutes of the 
discussion, ask students about modification of positions. 

The comments previously made regarding the ippncluding of discussions 
also apply here. 



■■■■■■ . . \ . . •■ , 
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_ \ • 

Technique : Discuss with students whether and how they want to continue 
to deal with the issue. / -/^ 

Measure : Percent of teachers who, during the last eight minutes of the 
.' discussion, discuss with students Vj^ether -^fii^ ^ 
to continue to deal with the issue. 



Again the problems in measuring the conclusion of a discussion apply 
here. In this case both experimental groups showed a noticeable improve- 
ment. 

Summary and Discussion 

Study 1 



The course appears successful jn (1) reducing the percent of teacher 
talk, (2) reducing the amount of non-moderator talk, and increasing the 
percent of moderators who (3) state issues explicitly, (4) question rele- 
vancy, (5) surrmarize, (6) ask for temporary agreement, (7) ask students to 
use techniques, (8) ask for a review, (9) ask students to state others* 
positions, (10) ask for modificatiyons, and (11) ask about the next step 
at the end of a discussion. / 

Some of the variables evinced low frequencies and are pos sibly of 



^1 i t^tTe praetrcal value wheTi^cof^ by themselves . Furthermo)re f i t i s 

not known how often techniques should be used; sometimes a single inter- 
vention may be effective* or perhaps none at all is needed. 

' . ■ ■ • . ■ • . ■ 
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Study 2 



On only four variables did moderators improve; (1) stating the 
issue, (2) asking students to use techniques, (3) asking for a'review, 
(4) asking students about the next step at the end of a discussion. 



I 




Table 8 

Student Use of Participant^Techniques - Lessons 1 and 2 

Ni=32 N2=ll ' 







Pre 


Post 




% Im- 


^affable 


Group 


; X" 


S.D. 


X 


S.D. 


t 


proving 


Lesson 1 
















Percent student talk 


M 


66% 


12-3 
. fi 7 


77i 


11 .1 

'12 fi 


4,.0** 
^ .5 


75% 
45% 


S t ud e n t:-^ to - s t ud G n t 
interaction 


•"2 


6.8 
.5.5 


6.2 
3.4 


15.0 
6.3 


8.6 
5.9 


4.5**. 
.3 


81% 
45% 


Students personal 
attack 


E2 

'1 . 


.1 

0 


;3 

. 0 


.6 
.1 


1.0 

. .2' 


2.5** 
- 1.0 


63%. 
81% . 


Lesson 2 

■■ ■ '. _ — 
















Students acknpwl edge a 
previous speaker 


2 


5.5 
4.7 


5.3 
2.9 


13.0 
5;5 


8.1 

5.3 


4.5** 

:.3 


81 % 
45% 


Students questi oni ng 
irrelevancy 


El 
E2 


0 
.1 

) 


V !l 

.3 


.4 
.1 


.7 
.3 


2.8** 

0 


34% 
0 



** p<.01 
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Evaluation of Students' Use of Participant Techniques 

e . 

Lesson 1 ^ 

Technique : Talk to each other rather than the moderator. / 
HBHure a : Percent of student talk in a five-minute sampT^. 

These figures are complementary to those found in Table 6, Percent 
o f Teacher Talk , / ^ 

Only tfte main experimental group showed a non-trivial increase in 

percent of student talk. 

J* 

Measure b : Student-student interaction in a five-minute portion (i.e., 
the number of times a student spoke after another student had 
just spok€n). 

For example, if ^ represei>fes a student speaker and T the teacher when 
o .speakihg, then ^T^TST represents three student-student interactions. 
One Of the main goa^ls of DC I was to get students to talk more to each 
other and less to the teacher. The course was clearly successful i^n in- 
creasing the student-student interaction for as shown in Table 8. 

technique : Av(jjid speaking in a hostile tone of voice or engaging in 
personal attack. 

Measure : Number of times hostility or personal attack occurred in a 
15-minute portion. 

Some indications of hostility were shouting and derogatory personal 

. ^ ** . 

reference. Frequencies are extremely low, indicating that students 
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generally do avoid hostility' in classroom discussion. It is interesting 
to note that, although the course treated the reduction of personal attack 
or hostility as desirable, James Shaver of Utah State University has said 
that he expects such attacks to increase as students get more involved in 
discussions.^ 

Lesson 2 

Technique : Acknowledge a previous speaker. 

Measure : In a five-minute portion, the number of times a student speaker 
prefaces his remarks by referring to the words or specific 
ideas of a previous speaker. ' ^ 

A large gain was made by E] students who more'^ than^ doubled their 
amount of acknowledgment. This group also exhibited a far greater per- 
centage of classes that improved from pre to post. 

Technique : Question the relevancy of speaker's remarks to th^issue being 
discussed. 

Measure : Number of times in 15 minutes that a student asks that a 

speaker explain how his comments are related to the issue at 
hand. . ' ^ 

Low frequencies again make the analysis of differences of academic 
interest. This variable is, of course, related to the extent that irrele- 
vant comments were made. 



^ personal coirmunication 
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Table 9 

/ 

Student Use of Participant Techniques 

Ni=32 N2=ll 



Lessons 3 and 4 



Variable 



Group 



Pre 



rs.D. 



Post 



S.D. 



% Im- 
proving 



Lesson 3 



Students asking 
for ^clarifi cation 

Students asking 
for evidence 

Students asking 
about values 



.0 

.1 

1.3 
2.2 

.1 

0 



.7 
.2 

2.0 
2.5 

.2 

0 



1.3 
.6 

3.0 
1.5 

.5 
.1 



1.5 
.8 

1.9 
.9 



3.1** 
2.2* 

4.4** 
-.8 

2.3* 
1.4 



Lesson 4 (Percentage of classes in which 
technique was used) j 



Students giving 
review 

Students stating 
position different 
than own 

Students modi- 
fying position 

Students stating 
where to go from 
here 



22%, 

zn- 



9% 



0 
0 



9% 



47% 
18% 



25% 
9% 

22% 
9% 



19% 
18% 



.02 
.50 



.01 
.75 

.01 
.50 



.03 
.50 



* p<.05 
** p<.01 



^ Probability levels derived from the Binomial Test (Siegel, pp. 36.-42) 
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Lesson 3 ^ 
Technique : Ask for clarification 

Measure: In a 15-minute portion of the discussion, the number of times 
a student asks a speaker to clarify what he said. 

Both groups showed an increase in the use of this skill. The overall 
goal for Lesson 3 was to give some depth to the discussion. 

Technique : Ask for evidence. 

Measure: In a 15-minute portion of the discussion, the number of times 
a student asks the speaker to back up his assertion with 
evidence. 

Students in showed ? clear increase in the use of this skill. 

Because students also gave more reasons after the course , the in- 
crease in asking for evidence is probably more substantial ttian it seems 
at first glance; i.e., there were more opportunities to ask for evidence 
ory the pre- than on the posttest. 

• r V ' • ••• 

Technique : Ask about values. \ 

Measure: In a 15-minute portion of the tape, the number times a 
student asked about values. ^ ' 

0 

' : ' ' . ■ ■ ■ I 

Low frequencies were found. It appears that the course was unsuccesjs 
ful in getting students to make much use of this technique.. It is possib'l 
that in a 25-ininute discussion it is not appropriate to ask about ^^alues! 
because the level of communication is still somewhat superficial. 
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Lesson 4 

Technique ; Review the main points of discussion. 

Measure : During the last eight minutes of the discussion^ whether or 
not a student reviewed the main points. 

As with all the Lesson 4 measures^ student performance is highly de-* 
pendent on the teacher's performance as moderator. As shown in the pre*- 
vious section* moderators did not make substantial use of the Lesson 4 
techniques. In this case, for example, if the moderator asked for a 
review then students had a higher probability of actually giving one. Stu- 
dent reviews were not counted if they were grossly inaccurate or mere re- 
statements of the particular speaker's position,. 

As shown in Table 8, only E-i showed any improvement. It is impor- 
tant to remember that several classes felt they did not have time to con- 
elude the discussion and hence did not get around to using the techniques 
of Lesson 4. ' . ' ^ 

Technique : State positions different from yours. 

Measure: During the last eight minutes of the discussion, whether or not 

a student stated another student's position. 
■ ■ - ■ t . ■' 

Again only E] made an improvement, - However ,^ it should be noted that 

even in this group, 75% of the classes did not use the technique on the post- 

^ - ■ ■ ■ . ' 

tape. 

Technique : State any modification you* ve made in your own petition. 
Measure : During the last eight minutes of the discussion, whether or not 
a' student expressed a modification of his position. 



The results here should be interpreted in relation to the moderator 
results described earlier. 

There was some improvement, but low postcourse levels. If none of the 
students in a discussion modified their positions, this is not necessarily a 
poor discussion. 

Technique : Decide whether and how you want to continue to deal with the 
issue. 

Measure: During the last eight minutes of the discussion, whether or not 
a student discussed how to continue to deal with the Issue. 

Both groups showed moderate increases. In each case a larger per- 
centage of moderators discussed the next step than did students. 

Summary and Discussion 

The main experimental group improved for all course behaviors except 
for engaging in personal attack; however, the students in E2 made fewer and 
smaller gains. The most significant E-j gains were in student-to-student 
interaction, acknowledgment of a previous speaker, asking for evidence, and 
the four Lesson 4 techniques. 
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RATING SCALE RESULTS 



Critiquers, students, and teachers each used the same scale to rate 
the discussion on six aspects. These measures were an attempt to discern 
(1) differential rater perceptions, in particular, between students and 
teachers; (2) perceptions of shifts; and (3) differences in^^erceptions 
among the two treatment groupings. 

The critiquers did not use these forms until several tapes had 
already been scored. This explains why the N for critiquers is lower than 
the N's for students olr teachers. 

All three groups of raters (students, teachers, critiquers) seem gen- 
erally to agree about the trends-with regard to smoothness of the discus- 
sion. They all perceived that E] improved slightly (but the teacher raters 
no.ted a somewhat greater improvement). 

Table 10 presents the results for ratings 1 to 3. The first rating 

j 

measures the extent to which students interact with each othfer rather than 
with the moderator. Substantial gains were made by Ei. 

For the ratings of the extent to which students appear to be listening 
to each other, all raters detected an increase for E-|. The results for the 
other group are mixed. There was one large shift perceived: teachers in E2 
felt their discussions improved. 

Table 11 presents ratings 4 to 6. Rating 4 measures the extent to 
which the pre- and postcourse discussions stayed focused on the issue. 
For Study 1, only the teachers noted a substantial improvement. This in part 
is explained by their low initial rating of 2.3. Eg received mixed reviews. 
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Table 10 
Results of Ratings 1, 2, and 3 



=30 Students 
29 teachers 
20 Crfti'quers 



N2=10 Students 
JO Teachers 
9 Critlquers 



Group 


Raters 


Pre 


Post 


t 


% Im- 
proving 


X ; S.D. 

1 


X 


S.D. 






1 — H — H 











Rating 1 



1 

Discussion bogged down 



Moved along smoothly 



E2 



Rating 2 



Students 


3.0 






11?? 


.5 




.3 , 




Teachers 


2.5 




:[ 




.8 


3 


.0**1 


46% 


Critlguers 


3.1 






3.2 


.6 




.4 


45% 


Stu3ents 


2.9 ' 




.3 


2.7 


V7 




.9 


30% 


Teachers 


2.7 . 




.8 


2.3 


.8 


-1 


.3 


20%, 


Critlquers 


3.4 




.5 


3.2 


.6 


-1 


.1 


22% 


1 

Talked to moderator 






4 

— »■ Talked to 


each 


other 


Students 


2.8 




.7 


3.2 


.5 


3 


.7** 


73% 


Teachers 


2.3 




.9 


3.1 


.8 


5 


!o** 


71% 


Critlquers 


2.3 




.8 


3.2 


.8 


3 


.7** 


75% 


Students 


2.7 


1 


•1 


2.6 


.6 




.3 


50% 


Teachers 


'2.3 


1 


•T 


2.3 


1.0 




0 


50% 


Critlquers 


2.7 


1 


•1 1 


i 2.6 


1.0 




.1 


33% 



Rating 3 ,1 

Students not listening 



Really listening 





Students 


3.3 


.3 


3.4 


.4 


.9 


53% 




Teachers 


3.1 


.8 


3.3 


.6 


.8 


29% 




Critlquers 


3.0 


.7 


3.2 


.6 


1.2 


50% 


E2 


Students 


3.3 


. .5 


3.2 


.6 


- .8 


30% 




Teachers 


3.^ 


.6 


3.6 


.5 


2.4* 


40% 




Critlquers 


2.9 


.7 


3.0 . 


.5 


.2 


44% 



* p<.05 
**p<.Ol 

■ o 
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Table 11 t 

Results of Ratings 4, 5, and 6 

Ni=30 Students 
29 Teachers 
20 Critiquers 



Group 


Rater^ 


Pre 


Post 


t 


% Im- 
proving 


X 


S.D. 


X 

i 


S.D. 


Rating 
El 


4 

U 1 dUUd d 1 Uil 

Students 
Teachers 
Critiquers 


1 

wandere 

3.1 
2.3 
3.0 


d ^- 

.5 
.7 
.6 


i 
f 

--4- Fo 

2.9 
3.0 
3.1 


4 

c'jsed on 

.6 
.5 
.8 


- .9 
4.3** 
.1 


40% 
61% 
50% 


E2 

Rating 
El 


Students 
Teachers 
Critiquers 

5 

no 1 earn 1 n 

Students 
Teachers 
Critiquers 


3.0 
2.6 
2.8 

1 

g 

3.0 
2.7 
2.4 


1.6 
.5 

.4 
.7 
.7 


2.7 
2.8 
2.9 

St 

3.2 
3.1 
2.7 


.4 ■ 

.8 

.3 

4 

udents 1 

.4 

.7 

7. 


-2.0 
.5 
.7 

carneQ 

2.2* 
2.3* 
1.3 


30% 
40% 
33% 

53% 
43% 
45% 


Rating 
El 


c+iiHi>ritc 

O tUUCf 1 

Teachers 
Critiquers 

6 

Discussion 

Students 
Teachers 
Critiquers 


2.9 
2.8 
2.3 

1 

of no e 

2.6 
2.3 
1 .8 


.3 
.9 
.5 

ffect-^-- 
.4 

:8 

.7 


2.7 
2.9 
2.3 

Re 

2.8 

2.7' 
2.2 


.7 
.6 
.4 

4 

suited i 

.4 
.8 
.7 


-1 0 
.4 
.2 

n positi 

1.8* 
2.2* 
2.2* 


30% 
33% 

ve action 

53% 
46% 
70% 


^2 


Students 
Teachers 
Critiquers 


2.6 
2.3 
1.9 


.8 
.8 


2.4 
2.6 
1.6 


.6 
.5 
.7 


-1.0 
1.0 
- .6 


20% 
40% 
33% 



N2=10 Students 
10 Teachers 
9 Critiquers 



* p<.05 
** p<.01 
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Rating 5 measures the extent to which students learned something from 
the discussion. All raters felt that Ei Improved. 

Rating ^» which Is also summarized in Table 11» measures the extent 
to which the discussion resulted in positive action being taken. E] was 
seen to have improved by all raters. Teachers felt that E2 improved while 
students and critiquers felt otherwise. 

' ■ ■ ■ . ■ ■ . ■ . / 

Summary and Discussion- 

Conclusions must be tempered by the fact that the ratings tended to have 
low reliability coefficients. 

The main experimental group was seen t(^ have improved by alT three 
groups of raters on every rating except number 4 (whether the discussion 
focused on the issue). For this rating, students noted a slight decrease, j 
but teachers perceived a substantial improvement. The E2 group exhibited 
shifts both up and down, but mostly down. 
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POSTCOURSE TEACHER QUESTIONNAIRES; 
I . Resume from Long Form 

• • •. , ... ..( • ^ . . . ^ 

The following summary is taken from a more detailed compilation by 
Rachel Ann Elder (1971). 

Postcourse Teacher Questionnaires were filled out by 36 teachers (21 
male ^nd 15 female) with an average of 8 years of teaching experience 
(range 2 to 21 years). In general, the teachers strongly support the 
usefulness of the course arfd urge its further development; they made 
many suggestions for revision of specific aspects of the course but 
listed more strengths than weaknesses, for all the major components O"*^/^- - 
the course: 

1, Teacher Handbook. Most- teachers commented favorably on the clarity 
and good organization of the handbook, although half of the teachers 
made suggestions for revisions of one or more specific items. 

2. Student Handbook. The majority of the teachers felt that tlie stu- 
dent handbook was well -written, although a fourth of the teachers 
found the handbook too difficult for at least some of their students 
to read and a sixth of the teachers commented Ithat it was not sophis-r 
ticated enough for older, brighter students. Thus, the handbook 
seemed to be, as intended, most usable for thb so-called average 
high school student. Although half the teachers reported students' . 
negative reactions to the handbooks and suggested changes in format 
to make it more interesting, varied, and less formal, no teacher 
recommended elimination of the Student Handbook. The teachers 
seemed to agree with the content of the student materials, but to ask 
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that the format be modified so that the teacher can select the level 
of difficulty and the timing according to the characteristics of the 
students in the class. 

Self-check Exercises. Although most of the teachers supported the 
ndea of having self-check exercises, students did non always see the 
purpose of the exercises and some of the exercises need to, be re- 
vised because they are too ambiguous or too easy. 

Self-evaluation forms. These were generally considered an important 

o 

/Strength of the course, although revisions may be needed to provide 
more variety in format and make them more adaptable for different 
students. 

Videotapes. Teachers found these useful , but a fourth of them encoun 
tered difficulties in the model films, especially ambiguous items in 
the model film check lists. About a fourth of them encountered tech- 
nical difficulties with the video equipment. 
Classroom Discussion Set-up (three groups at one 'time). Teachers 
seemed to have more difficulties with the small discussion groups 
than with the parts of the course previously discussed; at the same 
time two-thirds of the teachers reported advantages of the small 
groups. Suggestions for varying or adapting this procedure might 
be helpTul . ^ 
Tape Recording and Playing Back Some of Your Discussions. Two- 
thirds of the teachers had difficulties in obtaining usable tapes, 
but two-thirds also reported this as valuable for students. Teachers 
did not comment on its value for their own learning. Teachers need 
more help in learning how to obtain usable tapes, and probably .also 
in how to use the feedback. 
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8. Coordination of the Course by Far West Laboratory Personnel. Al- 
though the teachers were in general favorably impressr ' with coor- 
dination by Far West personnel, it is clear that this course, at 
least in its present form, is not completely self-instructional 
for the teacher— the teacher needs and appreciates support in 

carrying through on this course. 

■ , ■ /■ 

The most frequently listed interesting topics were legalization issues 
(drugs, abortion, capital punishment, prostitution, etc.) and school 
issues (compulsory attendance, grading, and local school policies). 
Human relations, social revolution methods, and war issues were less 
frequently mentioned. 

Of the 36 teachers, 34 observed changes in their students; in addition 
to learning teclfhiques of the course, some teachers reported that stu- 
dents have increased respect for each other. 

Half the teachers reported that some of their students thought the 

course beneficial and some were negative. A fourth of the teachers reported 

students were positive about the value of the course and a fourth said j 

most of the students were negative. So many teachers reported widely 

divergent student responses within a classroom that "it seems clear that 

there are important student variables related to positiveness and nega- 

tiveness toward the course. Intelligence or previous academic records 

were not given as characteristics associated with student evaluations 

* ■ "* 

of the course. Satisfaction seemed to be associated with haying learned 

some of the techniques, and dissatisfaction seemed to be associated with Dis- 
cussing Controversial Issues having replaced part of a course which the student 
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had chosen and with students not seeing the Importance of learning dis- 
cussion techniques. Of the 35 teachers^ 34 felt that this course should 
be included In the high school curriculum. 

learly a third of the teachers reported that they talk less. in discus- 

\ "» • • . " ■' ■ 

sions s\nce taking the course and a sixth say they are better listeners. 
These \, a re\techniques emphasized in the first part of the course. Tech- 
niques in t^e last part of the course were less frequently mentj^oned, 
but teachers commented on many influences on their teaching that were 
related to the course, but not to specific techniques, 

The majority of teachers felt the course was suitable for all high 
school students, although seven would recommend it mainly for yl^ungeri 
high school students and an equal number for juniors and seniors. It 
would seem appropriate to continue to say that the course is intended 
for grades 9-12. 

The course is seen by teachers as being equally appropriate for social 
studies and English courses. 

.\ . ■ ■ - ■ . 

If teachers could choose how and when to use the course with students, 

most of them would ^either use it at the jbeginning of the year or inte- 
grate the materials into their ongoing course. Student materials should 
therefore be produced in forms and media to facilitate such varied uses. 

Almost all the teachers fielt that Discussing Controversial Issues 
was better or much better than other inservice education courses they 
have taken. Teachers had a positive attitude toward the course and urge 
its further development. They seemed to ask for three types of revisions: 
greater flexibility in scheduling, more emphasis on research and analysis 
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of issues, and more variety and interest in the Student Handbook. This 
seems to indicate that teachers are willing to put more of their own 
time and effort into adapting the course rather than expecting revisions 
that would make this a self-contained unit for students. .However, they 
would appreciate a more interesting Student Handbook. 

The following tables convey a type of global assessment by teachers 
of the course. 



Table 12 

Compare Discussing Controversial Issues with 
your other inservice education experiences 

V. 

Much better 
Better 
On par 
Worse 

Much worse 
No others 
Blank 



Total 36 









Table 13 


Assumina--thfri 


t'UTscijssinq Controversial Issues is revised to correct 


the deficiencies, do you feel 


it should be included in the high school 


curriculum? 




Yes, strongly 




16 




17 


Yes 




1 


Uncertain 




■ 0 


No 




0 


No, strongly 




i 1 


Optional 




J_ 


No, should 4>e incorporated in 






subjects being taught 




Total 36 





11 

18 
4 
0 
0 
2 
1 
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Teacher Questionnaire - Short Form 

After both the pre and post discussions, teachers used a rating 
scale to assess their attitudes and skills. For the resu^s shown in 
Table 14, the percent gaining indicates those teachers whose postratings 
were higher than their prera tings. Since a 4-point scale was used, the 
minimum gain counted would be of one unit. 

Both groups expressed a high level of comfortableness regarding 
having discussions of controversial iss^ues in their classes. This is 
understandable in view of the fact that the teachers involved volunteered 
to take the course. 

Both groups of teachers perceived an improvement in their skill as 
moderators. The percentage gaining as well as the size of the gain were 
substantial . 

The data from' Question 3 exhibit a trend similar to that shown for 
the second question. Teachers who took the course felt they improved in 
their ability to moderate discussion's as wiTll as teach the skills needed. 

E] started at a lower level but equalled E2 on the posttest, in 
responding to the question on understanding the issue beijig discussed. 

For the final question, neither of the groups- expressed any real 
change in their responses regarding consideration of values although^ their 
entry levels were on the high side. 



ERLC 
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Table 14 

Teacher Questionnaire - Short Form 
Ny=29 N2=10 



Group 


Pre 


Post 


t 


% Im- 
provi ng 


X 


S.D. 


X 


S.D. 


1. How do you feel abou 
Uncomfortable 

k 


t having 
1 

3.9 
4.0 


controv 

.4 

0 


1 
1 

ersial i 

3.8 
3.8 


ssues in 
4 

Comforta 

.5 
.4 


your cl 

ble 

- .4 
-1.5 


ass? 

7% 
0 



2. Your skill as a moderator is 

1 

in need of a lot of improvement 



:i 



satisfactory 



2.3 




3.1 


.6 


2.4 




3.2 


.8 



.1**1 

.4* 



64% 
70% 



3. Your understanding of how to teach discussion skills is 

1 4 
unsatisfactory satisfactory 



El 


2.2 


.9 


3.2 


.6 


5.1**1 68% 




2.2 


.8 

■ 


3.1 


.7 


2.6* 70% 



As a result of the discussion, your understanding of the issue 

1 4 



became less clear 








became clearer 






2.9 
3.2 


.8 
.6 


3.4 
4 A 


.7 1 2.5* 
.7 -7 


54% 
30% 



5. In a controversial issues discussion, consideration of values is 

1 4 
usually inappropriate of prime importance 



El . 


3.5 


.7 


3.5 I .6 


.2 


25% 


• E2 


3.4 


.7 


3.3 1 .5 

i 


- .4 


20% 



* p<.05 
** p<.01 
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POSTCOURSE STUDENT QUESTIONNAIRES 



/ 



Questionnaires were summarized by class with answei^s ranked in order 
of frequency* Tallies represent classes: for examplG^ under Student Com- 
ments on the videotapes, 12 classes had "need a b^ter model film- checklist" 
as one of the three most frequent responses. N*42 classes. 



/ Table 15 

/ . ■ " 

/ 

Comments on Handbooks/ 

26 Simplify ,/use easier vocabulary 

18 Condense/ 

17 Make mQY'e interesting 

13 More examples 

7 Explain techniques better 

7 Less repetition 

7 Make less easy 
6 Eliminate book 

4 Def i ne hard words 

4 Use multicolors 

4 More detail 
3 ITTustrate 

3 More exercises 

3 More con' ersation 

Comments on Videotape (How to Improve) 

12 Better model film checklist examples. (less obvious) 

10 Explain techniques better 

9 Make less phony 

8 ' Use one group and one subject per film 
8 ^ Eliminate 

8 Larger screen 

6 Make more interesting 

6 Condense 

6 Color TV 

5 Fewer interruptions of discussions 
5 Explain answers better 

5 Better topics 

5^ Use negative examples, too 

5 Longer topics 

4 Better examples 
4 Better sound 

4 Less repetition 

4 Slower 



40^ 



Techniques Left Out> But Important 

5 Getting and bringing research evlder^ce 

4 Selecting Issues 

3 Bringing non-participants in 
2 Sticking to one topic 

2 How to keep Interest going 

Techniques that Should be Dropped 

5 Avoid hostile tone and personal attack 

4 Acknowledge previous speaker 
4 Avoid monopolizing 

3 Ask about values 

2 Supportive evidence 

What Did You Dislike About the Course? 

17 Too long 

17 Boring 

16 Issues chosen 

16 Reading handbook 

10 Videotapes 

8 Taping discussions 

8 Forced discussions 

7 Too short 

6 InfTexible time schedule 

5 Not enough controversy 

5 Discussing in front of others 

4 Papers required 



Overall 5 What did you lik^ about the course? 

25 Being able to talk freely 

23 The discussions 

17 Learning the techniques 

16 Hearing what others had to say 

12 The videotapes 

8 Learned more about the topics 

8 Interesting new topics 

7 Different from other courses 

6 Helped overcome shyness 

6 Little Qr no outside work 

6 Student interaction 

5 Up-to-date topics 

5 Chance to discuss controversial issues in class 
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What Didn't You Discuss that You 
Would Have Liked To? 



What Were the Three Most Interesting 
Issues That You Discussed? 



22 


OruQS 


15 


Abnrti on 


17 




in 




12 


Frnloax/ 


o 


Unmpn ' q 1 i hpr^i'fi nn 
, nuiiicii d II uci a t# 1 uii 


10 


nUU 1 L 1 UN 


7 


i/r art 


9 


Premarital ^ex 


6 


Hanital nuni^hmpn't 


9 


Galley 


6 


Callev 


9 


Relioion 


5 


Premarital ^ex 


7 


Women's liberation 


5 


Population 


7 


Draft 


4 


Space program 


7 


Marrlaop 

1 lUI 1 ■ 


4 


Vietnam War 


6 


Racism 


4 


Bussing 


6 


Police brutality 


3 


Compulsory education 


5 


Welfare 


3 


Religion 


5 


Generation Gap 


3 


Police brutality 


i; 


Canital nunishment 


3 


Prostitution 


4 


Sports 






4 


18 year olds' vote 


(three choices per class, 


4 


Space program 






3 


Birth control 






3 


Compulsory education 






3 


Euthanasia 






3 


Bussing 






3 


Open campus 






3 


Government 1 nf 1 uence 






3 


Parent/child relationship 







When asked to compare 'DC^ with their other courses, the students 
in the experimental groups made the following responses: 





E-| (33 classrooms 
440 students) 


Eo (.9 classrooms 
80 students) 


Better 


305f 


31% 


On par 


49% 


54% 


Worse 


21% 


1,5% 



After the pre- and posttape discussion, the students in the discussion 
filled out a one-page questionnaire. Some of the results were reported 
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earlier in the section on Rating Scales. The remaining results, discussed 
below, are sumnarized in Table 16. 

Item 1: Students in clearly indicated that DCI_ resulted in an 

increase in student involvement in choosing the issue. Those 
in E2 apparently were already involved in choosing the issue. 

For items 2 and 3, it was considered desirable for the 
middle category ("remained the same") to decrease. The rationale 
here is that the discussion should affect the participants in some 
way, including what might be considered negative ways. 
Item 2: The major change shown by E-j was an 8% increase in the per- 

centage of students whose understanding of their own position 
became clearer, complemented by a 9% decrease in the percentage 
of students whose understanding remained the same. £3 showed an 
increase in the proportion of students whose understanding of 
their own position became clearer, with an accompanying downshift 
in the proportion of students whose position remained the same. 

Item 3: E-j students indicated an increase while E2 stu^ients showed a 

decrease in the proportion of students whose understanding of 
others' positions became clearer. 

Item 4: After the course, a larger percentage of Ei students and a 

smaller percentage of E2 students felt that the discussibns 
strengthened their original position. For an increased per- 
centage said their positions had been modified somewhat. 
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Item 5: The main finding here is that as a result of the course, 

the percentage of Ey students who spoke several times increased, 
while the percentage of £3 students that did not speak at a11 was 
decreased. This corroborates our finding that in some of the 
E2 schools which had a number of immigrants from Hong Kong, the 
teachers reported that, as aujcesult of the course, some students 
were speaking up in class for the first time. 
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\ Table 16 

^ Short Student Questionnaire: Study 1 and Study 2 







E2- 


Pre 


Post 


Pre 


Post 


1. , The issue was chosen by 

Teachers and Students \ 
Teacher Only 

Students Only ' 


36.4% 
44.5% 
19.1% 


59.6% 
15.9% 
24.4% 


61.9% 
17.5% 
20.6% 


68.8% 
16.2% 
15,0% 



2. As a result of the discussion, your .understanding of your own posi- 
tion on the issue 



Became less clear 
Remained the same 
Became clearer 



3.6% 
49.7% 
46.7% 



3.1. Your under stand ing of the jjos i t i on of others 



Became less cliear 
Remained the same 
Became clearer 



2.9% 
24.8% 
72.3% 



4.8% 
40.6% 
54.6% 



4.2% 
17.6% 
78.2% 



1.0% 
57.7% 
41 .2% 



5.2% 
32.3% 
62.5% 



4. As a result of the discussion, your original position was 



Strengthened 
Modified somewhat 
Weakened 



5. During the discussion you spoke 

■ • \ ■ 

Several times 
A few times 
Not at all 

* 



36.7% 
57.0% 
6.2% 



38.4% 
52.2% 
C.4% 



43.8% 
52.8% 
3.4% 



48.3% 
43.9% 
7.8% 



43.3% 
147.8% 
8.9% 



29.6% 
57.1% 
13.3% 



6.4% 
42.3% 
51.3% 



3.8% 
38.5% 
57.7% 



35.5% 
56.6% 
7.9% 



32.9% 
58.2% 
8.9% 
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USE OF sfqDENT HANDBOOKS 

As an unobtrusive measure of actua\ student use of the course materials 
52 Student Handbooks were collected after\;he course was over. 



Table 17 \ 
Use of Handbook Exercise: 





% of Students Doing Exercises 








Self-Evaluation 


Lesson 


Model Film 
Checklist 


Self-Check 
List 


First 

Discussion 


Second 
Discussion 


1 


87 


42 


71 


63 


2 


80 


53 


65 


62 


3 . 


86 


1 

75 


71 


33 • 


4 


.75 


51 


73 


54 



Although the individual percentages fluctuate, the overal 1 use by 
students remained relatively constant throughout the four lessons; for 
example, fewer students did the model film checklist and self-checklist 
for Lesson 4 than Lesson 3, while more s^tudents used the Lesson 4 Evalua- , 
tion forms. 

An interesting study would be the investigation of the relationship 
between use of the exercises arid performance in discussions, this would 
be a first step In assessing the relative importance of the various facets 
of the course. 
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SUMMARY AND DISCUSSION 
Overan Assessment 

Overall, DCI^ produced an improvement in the use of discussion techniques 
among those classes in Study 1 who took the course. Some of the behaviors 
exhibited substantial shifts in the desired direction, while others were of 
too low a magnitude to be of practical value when considered individually. 
For some of the shifts^ we are not able to say whether or not the changes 
definitely represent an improvement.* 

The students in Study 2 who took the course Improved slightly. As 
utilized in the main field test, DCI^ did not accomplish its specific 
objectives with this group, which included opportunity and compensatory 
classes in urban schools. — When £i and £2 are compared ,~-they seBne4_Bqut^^ 
lent in their attitudes toward the course. On most variables, the two groups 
had comparable entry levels but quite different post course scores. 

In Study 2 both moderator and participants performed substantially 
worse than those in Study 1. There is possibly an interactive effect 
whereby -poor performance by say, the participants, promotes poor perform- 
a nee by th.e moderator. 

f' * ' ■ . 

Revisiols Based on Main Field Test Data 

In response to student corrroents on the course, the Student Handbook 
has been rewritten to incorpoJ^ate cartoons in an attempt to make the 
reading more interesting. In addition, the reading level was lowered and 



humor was added. The writing style became more direct and informal. 
Students indicated that they disliked the model tape checklist discrimina- 
tions. Accordingly, students are now asked to watch for certain discussion 
characteristics, and the model tape is intended to stimulate discussion. 

Both teacher and students had difficulty with the technique of 
asking about value bases. This technique has been dropped in th? most recent 
version. 

Because teachers complained about the rigidity of the four-week 
schedule, the revised course was made self-pacing. Each teacher will 
decide how long to spend on a lesson. 

Sample lesson plans were developed, based on what field test teachers 
said seemed to have worked the best. They provide guidelines for planning 
activities with students and suggestions for using the course materials, 
choosing topics, giving feedback, and giving assignments that maintain 
-Students' interest. 

Because the previous method of tape recording discussions and play- 
ing them back for the whole class proved unworkable, teachers are now 
asked to audiotape segments of- discussions that they moderate, and 
evaluate their performance using self-evaluation forins. 
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Table 22 

Results of Ratings 1, 2, and 3 — Control Group 



N|=12 Students 
13 Teachers 
10 Critlquers 



6 Students 
6 Teachers 
5 Critiquers 



Group 



Pre 



Raters 



Post 



% Im- 
proving 



Rating 1 1 4 

Discussion bogged down ^ Moved along smoothly 



students 


3.0 


.5 


2.8 


.4 


-1.3 


m 


Teachers 


2.8 


. .7 


2.7 


.8 


- .6 


23% 


Critiquers 


3.0 


'3.4 


2.8 


.7 


- .7 


20% 


Students 


3.4 . 




3.0 ■ 


-.3 


^-2.4 


m 


Teachers 


3.2 




2.5 


.6 


-1.6 


m 


Critiquers 


3.6 


, f 


3.1 


.2 


-3.2* 


0% 



I 



Rating 2 1 4 

Talked to moderator ■<- -»■ Talked to each other 



Cl 


students 


3.1 


.3 


'3.1 


^ .4 


.4 


33% 


Teachers 


3.0 


1.0 


3.0 


.9 


0 


23% , 




Critiquers 


2;6 


.9 


2.7 


.8 


.3 


20% 




Students 


3.0 


.7 


2.9 


.4 


- .6 


17% 




Teachers 


2.8 


>.o 


3.0 


.6 


.3 


50% 




Critiquers 


2.9 ' 


1.0 


2.5 


1.2 


- .8 


20% 



Rating 3 1 4 

Students not listening -«— — > Really listening 





Students 
Teachers 
Critiquers 


3.3 
3.5 
3.0 


.3 
.7 
.5 


3.2 
3.4 
2.9 


.4 
.5 
.7 


- .4 

- .7 

- ,2 


42% 
8% . 
40% 


C2 


Students 


3.4 


.4 


3.3 


.3 


- .9 


33% 


Teachers 


3.7 


.5 


3.5 


.6 


-1.0 


0% 




Critiquers 


3.5 


.5 


3.0 


0 


-2. '2 


0% 



•77 



* p<.05 (decrease) 
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Table 23 

Results of Ratings 4, 5, 6 — Control Group 

N|=12 Students 6 Students 

13 Teachers 6 Teachers 

10 Critiquers 5 Critiquers 



1 

1 

Group 1 Raters 


Pre 1 


Post 


t 


« Im- 
proving 


X 


S.D. 1 


J 


S.D. 

















Rating 4 1 4 

Discussion wandered Focused on Issue 





I Students 
Teachers 
Critiquers 


2.8 
2.7 
2.8 


.3 1 
1.0 

„. .6 


1 2.8 
2.8 
2.6 


.5 
.7 
.8 


- .4 
.2 

- .7 


42« 
31% 
30% 




' Students 
1 TeacherT 
1 Critiquers 


3.2 
2.8 
3.7 


•4 
.8 
.4 


2.7 » 
1 2.3 
1 2.3 


.6 
.5 
.9 


-1.5 
-2.2 
-3.1* 


33% 
0% 
0% 



Rating 5 1 4 

No learning ^-.^--.-j^ Students learned 



Cl 


Students 
Teachers 
Critiquers 


3.0 
2.5 
2.4 


.4 
.9 
.7 


2.9 
3.1 
2.3 


.5 
.9 
.4 


- .4 
2.2 

- .6 


33% 
54% 
20% 


,C2 


Students 


3.3 


.5 


3.0 


.4 


-2.6* 


17% 




. Teachers 


2.8 


.4 


2.8 


.8 


0 


33% 




Critiquers 


2.9 


.2 


2.3 


.3 


-3.2* 


0% 



Rating 6 1 4 

Discussion of no effect ^- Resulted In positive action 





Students 
Teachers 
Critiquers 


2.9 
2.5 
2.0 


.5 
1.0 
.7 


2.6 ,7* 
2.6 / 
1.8- 7 




r2.0 
- .6 


9% 
46% 
30% 




Students 


2.9 


.6 


2.5'v. 


.4 


^-4.2** 


0% 




Teachers 


2.2 


.4 


2.4 


.6 


1.0 


33% 




Critiquers 


2.2 


.8 


1.9 


.4 


-1.2 


20% 



' Q p<.05 (decreases) 
ERXC* P*^*^^ (decrease ) 
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Table 24 

Teacher Questionnaire — Control Group 



Ni=13 



N2=6 



Group 


Pre 


Post 


t 


% 

Improving 


X 


S.D. 


J 


S.D. 


1. How do you feel about h 

1 . 

Uncomfortable 
Ci 1 3.8 


aving con 

i \ 


trovers i a 

1 3.8 
1 3.7 


1 issues 

.6 
.8 


in your 
4 

Comforta 

0 
0 


class? 
ble 

0% 
17% 



2. 



Your skill as a moderator is 
1 



in need of a lot of improvement 

... J..iil.i:o J. 



Cl 

C2 



2.9 
2.8 



i. 



.9 
1.2 



satisfactory 



23% 
17% 



3. 



Your understanding of how to teach discussion is 

1 4 
unsiatisfactory satisfactory 



Cl 

C2 



I 2.8 I .9 I 2.9 I .6 I .3 I 2 
_[ 2.5 I .6 2.5 I .8 I 0,1 1 



23% 
7% 



As a result of the discussion, your understanding of the issue 

1 4 
became less clear became clearer 

Cl I 3.3 I .6 3.4 I .5 1 .4 I 31% 

^2 _[ 3.2 J[ 1.0 J_ 3.3 |_ [ J 



5. In a controversial issues discussion, consideration of values is 
1 ' 4 

usually inappropriate of prime 

% Importance 



Cl 


3.8 


.4 


3.8 


.4 


0 


8% 


C2 


3.2 


.8 


3.2 


•8 , 


.6 


33% 



55- 



Table 25 

Short Student Questionnaire: Study 1 and Study 2 — Control Group 





Cl 


^2 


Pre 


Post 


Pre 


Post 


T. The issue was chosen by: 

Teachers and Students 
Teacher Only 
Students Only 


30.2% 
48.3% 
21.6% 


35.2% 
45.7% 
19.0% 


61.5% 
23.1% 
15.4% 


66.0% ' 
29.8% 
4.3% 

1 



2, As a result of the discussion, your understanding of your own 
position on the issue 



Became less clear 
Remained the same 
Became clearer 



2.6^ 
44,8% 
52.6% 



5.7% 
39.6% 
54.7% 



3. Your understanding of the position of others 



Became less clear 
Remained the same 
Became clearer 



6.1% 
27.2% 
66.7% 



2.8% 
23.6% 
73.6% 



2.5% 
40.0% 
57.5% 



0.0% 
30.0% 

7o:o% 



4. As a result of the discussion, your original position was 



Strengthened 
Modified somewhat 
Weakened 



5. During the discussion you spoke 

- Several times 
A few times 
Not at all 



40.2% 
55.4% 
4.5% 



42.4% 
50.9% 
6.9% 



38.2% 
58.8% 
2.9% 



40.4% 
49.0% 
10.6% 



41 .0% 
56.4% 
2.6% 



32.5% 
60.0% 
7.5% 



4.3% 
55.3% 
40.4% 



2.1% 
33.3% 
64.6% 



44.7% 
53.2% 
2.1% 



35.4% 
54.2% 
10.4% 
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